Feature: Book Genie Mode - Automated Testing with Detailed Reporting
File name: BookGenie.feature
Relative path: features/BookGenie.feature
Scenario Outline: Book Genie Response Validation with Citation Verification
When
I open the Creative Workspace login page
00:00:02.787
Then
I should see the homepage
00:00:00.037
When
I click on the mode selection dropdown
00:00:00.000
Then
I can see the "BookGenieQA" mode
00:00:00.000
And
I select the "BookGenieQA" mode
00:00:00.000
Then
I type "Suggest 5 books on christmas" on chat input element
00:00:03.382
And
I wait for AI to complete thinking
00:00:07.253
And
I validate the response is visible for "Suggest 5 books on christmas"
00:00:00.008
And
I extract book data from BookGenie response
00:00:00.006
And
I save BookGenie book data to Excel file for query "Suggest 5 books on christmas"
00:00:00.000
+ Show Error
Error: No book data extracted from BookGenie response.
at CustomWorld.(anonymous) (/home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/steps/bookGenie.step.ts:46:15)
at /home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/steps/bookGenie.step.ts:8:71
at __awaiter (/home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/steps/bookGenie.step.ts:4:12)
at CustomWorld.(anonymous) (/home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/steps/bookGenie.step.ts:59:12)
And
I validate each book individually against Excel file for query "Suggest 5 books on christmas"
0s
And
I validate that reason texts match citation texts with 80% similarity
0s
And
I generate detailed citation validation report
0s
Then
I verify database connectivity
0s
And
database should contain 2020 books
0s
And
I validate extracted books individually against database
0s
And
I validate BookGenie response relevance with AI for query "Suggest 5 books on christmas"
0s
=== SCENARIO LOGS: Book Genie Response Validation with Citation Verification === [12:50:04 AM] Navigating to Creative Workspace login page [12:50:07 AM] Homepage visibility: false [12:50:07 AM] ℹ️ Typing query: "Suggest 5 books on christmas" [12:50:07 AM] ℹ️ Preparing to type query: "Suggest 5 books on christmas" [12:50:07 AM] ℹ️ Waiting for chat input to be visible [12:50:09 AM] ℹ️ Clearing chat input [12:50:09 AM] ℹ️ Typing query: "Suggest 5 books on christmas" [12:50:10 AM] ℹ️ Pressing Enter to submit query [12:50:11 AM] ✅ Query submitted successfully: "Suggest 5 books on christmas" [12:50:11 AM] ℹ️ Waiting for AI to complete thinking... [12:50:11 AM] 📋 WAITING FOR AI RESPONSE [12:50:11 AM] ℹ️ Looking for AI thinking indicator... [12:50:11 AM] ℹ️ Waiting for thinking indicator to appear (max 2 minutes) [12:50:13 AM] ✅ ✓ AI thinking indicator appeared - AI is processing the request [12:50:13 AM] ℹ️ Waiting for thinking indicator to disappear (max 5 minutes) [12:50:15 AM] ✅ ✓ AI thinking completed - Response should be ready [12:50:15 AM] ℹ️ Allowing additional time for response rendering [12:50:18 AM] ✅ AI response wait process completed [12:50:18 AM] ℹ️ Validating response for query: "Suggest 5 books on christmas" [12:50:18 AM] 📋 VALIDATING RESPONSE FOR QUERY: "Suggest 5 books on christmas" [12:50:18 AM] ℹ️ Locating the latest response in chat [12:50:18 AM] ℹ️ Waiting for response to be visible (max 30 seconds) [12:50:18 AM] ✅ Response received - Length: 608 characters [12:50:18 AM] ℹ️ Response preview: Watch Me WorkInterpreting context for your query...That sounds like a lovely theme! To help you find... [12:50:18 AM] ℹ️ Extracting book data from response... [12:50:18 AM] 📋 EXTRACTING BOOK DATA FROM RESPONSE [12:50:18 AM] ℹ️ Locating BookGenie response container [12:50:18 AM] ℹ️ Extracting HTML content from response [12:50:18 AM] ℹ️ HTML content extracted - Length: 7160 characters [12:50:18 AM] ℹ️ Parsing HTML to extract book data [12:50:18 AM] ✅ SUCCESSFULLY EXTRACTED 0 BOOKS [12:50:18 AM] 📋 EXTRACTED BOOKS SUMMARY [12:50:18 AM] 📊 Total books extracted: 0 [12:50:18 AM] 📊 Average relevance score: 0% [12:50:18 AM] ✅ Extracted 0 books from response === END LOGS ===
Scenario Logs: Book Genie Response Validation with Citation Verification
[12:50:04 AM] Navigating to Creative Workspace login page
[12:50:07 AM] Homepage visibility: false
[12:50:07 AM] ℹ️ Typing query: "Suggest 5 books on christmas"
[12:50:07 AM] ℹ️ Preparing to type query: "Suggest 5 books on christmas"
[12:50:07 AM] ℹ️ Waiting for chat input to be visible
[12:50:09 AM] ℹ️ Clearing chat input
[12:50:09 AM] ℹ️ Typing query: "Suggest 5 books on christmas"
[12:50:10 AM] ℹ️ Pressing Enter to submit query
[12:50:11 AM] ✅ Query submitted successfully: "Suggest 5 books on christmas"
[12:50:11 AM] ℹ️ Waiting for AI to complete thinking...
[12:50:11 AM] 📋 WAITING FOR AI RESPONSE
[12:50:11 AM] ℹ️ Looking for AI thinking indicator...
[12:50:11 AM] ℹ️ Waiting for thinking indicator to appear (max 2 minutes)
[12:50:13 AM] ✅ ✓ AI thinking indicator appeared - AI is processing the request
[12:50:13 AM] ℹ️ Waiting for thinking indicator to disappear (max 5 minutes)
[12:50:15 AM] ✅ ✓ AI thinking completed - Response should be ready
[12:50:15 AM] ℹ️ Allowing additional time for response rendering
[12:50:18 AM] ✅ AI response wait process completed
[12:50:18 AM] ℹ️ Validating response for query: "Suggest 5 books on christmas"
[12:50:18 AM] 📋 VALIDATING RESPONSE FOR QUERY: "Suggest 5 books on christmas"
[12:50:18 AM] ℹ️ Locating the latest response in chat
[12:50:18 AM] ℹ️ Waiting for response to be visible (max 30 seconds)
[12:50:18 AM] ✅ Response received - Length: 608 characters
[12:50:18 AM] ℹ️ Response preview: Watch Me WorkInterpreting context for your query...That sounds like a lovely theme! To help you find...
[12:50:18 AM] ℹ️ Extracting book data from response...
[12:50:18 AM] 📋 EXTRACTING BOOK DATA FROM RESPONSE
[12:50:18 AM] ℹ️ Locating BookGenie response container
[12:50:18 AM] ℹ️ Extracting HTML content from response
[12:50:18 AM] ℹ️ HTML content extracted - Length: 7160 characters
[12:50:18 AM] ℹ️ Parsing HTML to extract book data
[12:50:18 AM] ✅ SUCCESSFULLY EXTRACTED 0 BOOKS
[12:50:18 AM] 📋 EXTRACTED BOOKS SUMMARY
[12:50:18 AM] 📊 Total books extracted: 0
[12:50:18 AM] 📊 Average relevance score: 0%
[12:50:18 AM] ✅ Extracted 0 books from response
Scenario Outline: Book Genie Response Validation with Citation Verification
When
I open the Creative Workspace login page
00:00:02.485
Then
I should see the homepage
00:00:00.033
When
I click on the mode selection dropdown
00:00:00.000
Then
I can see the "BookGenieQA" mode
00:00:00.000
And
I select the "BookGenieQA" mode
00:00:00.000
Then
I type "Suggest 3 books for childrens" on chat input element
00:00:02.570
And
I wait for AI to complete thinking
00:00:13.856
And
I validate the response is visible for "Suggest 3 books for childrens"
00:00:00.007
And
I extract book data from BookGenie response
00:00:00.011
And
I save BookGenie book data to Excel file for query "Suggest 3 books for childrens"
00:00:00.010
And
I validate each book individually against Excel file for query "Suggest 3 books for childrens"
00:00:00.012
CITATION VALIDATION DETAILED REPORT ================================================================================ BOOK: Araminta Spookie 3: Frognapped ------------------------------------------------------------ ✅ Reason 1: PASS (95%) ❌ Reason 2: FAIL (0%) 📝 Reason: It is suitable for children aged 6-10... 📚 Citation: solving mysteries... ⚠️ Citation text not found in reason: "solving mysteries" ❌ Reason 3: FAIL (0%) 📝 Reason: The book includes illustrations by Jimmy Pickering... 📚 Citation: chapter books for kids ages 6-10... ⚠️ Citation text not found in reason: "chapter books for kids ages 6-10" BOOK: A Christmas Carol ------------------------------------------------------------ ❌ Reason 1: FAIL (0%) 📝 Reason: The book is a classic children's story... 📚 Citation: childrens christmas books... ⚠️ Citation text not found in reason: "childrens christmas books" ❌ Reason 2: FAIL (0%) 📝 Reason: It is designed for children aged 6 to 10... 📚 Citation: from 6 to 10... ⚠️ Citation text not found in reason: "from 6 to 10" ✅ Reason 3: PASS (100%) BOOK: A Series of Unfortunate Events #1: The Bad Beginning ------------------------------------------------------------ ✅ Reason 1: PASS (100%) ❌ Reason 2: FAIL (0%) 📝 Reason: It is designed for children aged 8 to 12... 📚 Citation: Interest age, years: from 8 to 12... ⚠️ Citation text not found in reason: "Interest age, years: from 8 to 12" ❌ Reason 3: FAIL (0%) 📝 Reason: The book includes humorous elements... 📚 Citation: Humorous Stories... ⚠️ Citation text not found in reason: "Humorous Stories" SUMMARY: 3/9 reasons passed (33.3%) OVERALL STATUS: FAIL
Citation validation failed: 3/9 passed (33.3%)
Citation Validation Summary: 3/9 passed
📊 Citation Validation Report
Generated on 10/10/2025, 12:52:13 AM
📖 Araminta Spookie 3: Frognapped
✅ Reason 1: 95% match
❌ Reason 2: 0% match
⚠️ Citation text not found in reason: "solving mysteries"
❌ Reason 3: 0% match
⚠️ Citation text not found in reason: "chapter books for kids ages 6-10"
📖 A Christmas Carol
❌ Reason 1: 0% match
⚠️ Citation text not found in reason: "childrens christmas books"
❌ Reason 2: 0% match
⚠️ Citation text not found in reason: "from 6 to 10"
✅ Reason 3: 100% match
📖 A Series of Unfortunate Events #1: The Bad Beginning
✅ Reason 1: 100% match
❌ Reason 2: 0% match
⚠️ Citation text not found in reason: "Interest age, years: from 8 to 12"
❌ Reason 3: 0% match
⚠️ Citation text not found in reason: "Humorous Stories"
📈 Validation Summary
Total Reasons Validated: 9
Passed: 3
Failed: 6
Pass Rate: 33.3%
Overall Status: FAIL
Then
I verify database connectivity
00:00:00.190
And
database should contain 2020 books
00:00:00.103
And
I validate extracted books individually against database
00:00:00.349
And
I validate BookGenie response relevance with AI for query "Suggest 3 books for childrens"
00:00:06.218
+ Show Info
+ Show Info
PER-BOOK AI VALIDATION REPORT - Query: "Suggest 3 books for childrens"
================================================================================
OVERALL RELEVANCE SCORE: 70%
STATUS: FAIL
BOOKS ANALYZED: 3
BOOK 1: "Araminta Spookie 3: Frognapped"
------------------------------------------------------------
Overall Score: 70%
SECTION SCORES:
Author Information: 70% - Analysis unavailable - API error
Publishing Date: 70% - Analysis unavailable - API error
Why Match Explanations: 70% - Analysis unavailable - API error
Relevance Scores: 70% - Analysis unavailable - API error
DETAILED FEEDBACK:
• AI analysis temporarily unavailable due to service overload
IMPROVEMENT SUGGESTIONS:
• Retry analysis when service is available
================================================================================
BOOK 2: "A Christmas Carol"
------------------------------------------------------------
Overall Score: 70%
SECTION SCORES:
Author Information: 70% - Analysis unavailable - API error
Publishing Date: 70% - Analysis unavailable - API error
Why Match Explanations: 70% - Analysis unavailable - API error
Relevance Scores: 70% - Analysis unavailable - API error
DETAILED FEEDBACK:
• AI analysis temporarily unavailable due to service overload
IMPROVEMENT SUGGESTIONS:
• Retry analysis when service is available
================================================================================
BOOK 3: "A Series of Unfortunate Events #1: The Bad Beginning"
------------------------------------------------------------
Overall Score: 70%
SECTION SCORES:
Author Information: 70% - Analysis unavailable - API error
Publishing Date: 70% - Analysis unavailable - API error
Why Match Explanations: 70% - Analysis unavailable - API error
Relevance Scores: 70% - Analysis unavailable - API error
DETAILED FEEDBACK:
• AI analysis temporarily unavailable due to service overload
IMPROVEMENT SUGGESTIONS:
• Retry analysis when service is available
================================================================================
SUMMARY FEEDBACK:
----------------------------------------
• AI analysis service is temporarily overloaded
• Using fallback analysis with neutral scores
• Error: [GoogleGenerativeAI Error]: Error fetching from https://generativelanguage.googleapis.com/v1beta/models/gemini-2.5-pro:generateContent: [429 Too Many Requests] You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits.
* Quota exceeded for metric: generativelanguage.googleapis.com/generate_content_free_tier_requests, limit: 2
Please retry in 39.676732925s. [{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_content_free_tier_requests","quotaId":"GenerateRequestsPerMinutePerProjectPerModel-FreeTier","quotaDimensions":{"location":"global","model":"gemini-2.5-pro"},"quotaValue":"2"}]},{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"39s"}]
OVERALL IMPROVEMENT SUGGESTIONS:
----------------------------------------
• Retry the analysis when Gemini API is less busy
• Consider running tests during off-peak hours
• Check Google AI status page for service updates
🤖 PER-BOOK AI Response Relevance Validation
Query: "Suggest 3 books for childrens"
Overall Relevance Score: 70%
Status: FAIL
Books Analyzed: 3
Individual Book Analyses
📖 Book 1: "Araminta Spookie 3: Frognapped" - 70%
Author Information: 70%
Analysis unavailable - API error
Publishing Date: 70%
Analysis unavailable - API error
Why Match Explanations: 70%
Analysis unavailable - API error
Relevance Scores: 70%
Analysis unavailable - API error
Improvement Suggestions:
💡 Retry analysis when service is available
📖 Book 2: "A Christmas Carol" - 70%
Author Information: 70%
Analysis unavailable - API error
Publishing Date: 70%
Analysis unavailable - API error
Why Match Explanations: 70%
Analysis unavailable - API error
Relevance Scores: 70%
Analysis unavailable - API error
Improvement Suggestions:
💡 Retry analysis when service is available
📖 Book 3: "A Series of Unfortunate Events #1: The Bad Beginning" - 70%
Author Information: 70%
Analysis unavailable - API error
Publishing Date: 70%
Analysis unavailable - API error
Why Match Explanations: 70%
Analysis unavailable - API error
Relevance Scores: 70%
Analysis unavailable - API error
Improvement Suggestions:
💡 Retry analysis when service is available
Summary Feedback
• AI analysis service is temporarily overloaded
• Using fallback analysis with neutral scores
• Error: [GoogleGenerativeAI Error]: Error fetching from https://generativelanguage.googleapis.com/v1beta/models/gemini-2.5-pro:generateContent: [429 Too Many Requests] You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits. * Quota exceeded for metric: generativelanguage.googleapis.com/generate_content_free_tier_requests, limit: 2 Please retry in 39.676732925s. [{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_content_free_tier_requests","quotaId":"GenerateRequestsPerMinutePerProjectPerModel-FreeTier","quotaDimensions":{"location":"global","model":"gemini-2.5-pro"},"quotaValue":"2"}]},{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"39s"}]
Overall Improvement Suggestions
💡 Retry the analysis when Gemini API is less busy
💡 Consider running tests during off-peak hours
💡 Check Google AI status page for service updates
=== SCENARIO LOGS: Book Genie Response Validation with Citation Verification ===
[12:50:20 AM] Navigating to Creative Workspace login page
[12:50:22 AM] Homepage visibility: false
[12:50:22 AM] ℹ️ Typing query: "Suggest 3 books for childrens"
[12:50:22 AM] ℹ️ Preparing to type query: "Suggest 3 books for childrens"
[12:50:22 AM] ℹ️ Waiting for chat input to be visible
[12:50:23 AM] ℹ️ Clearing chat input
[12:50:23 AM] ℹ️ Typing query: "Suggest 3 books for childrens"
[12:50:25 AM] ℹ️ Pressing Enter to submit query
[12:50:25 AM] ✅ Query submitted successfully: "Suggest 3 books for childrens"
[12:50:25 AM] ℹ️ Waiting for AI to complete thinking...
[12:50:25 AM] 📋 WAITING FOR AI RESPONSE
[12:50:25 AM] ℹ️ Looking for AI thinking indicator...
[12:50:25 AM] ℹ️ Waiting for thinking indicator to appear (max 2 minutes)
[12:50:27 AM] ✅ ✓ AI thinking indicator appeared - AI is processing the request
[12:50:27 AM] ℹ️ Waiting for thinking indicator to disappear (max 5 minutes)
[12:50:36 AM] ✅ ✓ AI thinking completed - Response should be ready
[12:50:36 AM] ℹ️ Allowing additional time for response rendering
[12:50:39 AM] ✅ AI response wait process completed
[12:50:39 AM] ℹ️ Validating response for query: "Suggest 3 books for childrens"
[12:50:39 AM] 📋 VALIDATING RESPONSE FOR QUERY: "Suggest 3 books for childrens"
[12:50:39 AM] ℹ️ Locating the latest response in chat
[12:50:39 AM] ℹ️ Waiting for response to be visible (max 30 seconds)
[12:50:39 AM] ✅ Response received - Length: 2060 characters
[12:50:39 AM] ℹ️ Response preview: Watch Me WorkInterpreting context for your query...Retrieving Relevant Books for 'books suitable for...
[12:50:39 AM] ℹ️ Extracting book data from response...
[12:50:39 AM] 📋 EXTRACTING BOOK DATA FROM RESPONSE
[12:50:39 AM] ℹ️ Locating BookGenie response container
[12:50:39 AM] ℹ️ Extracting HTML content from response
[12:50:39 AM] ℹ️ HTML content extracted - Length: 26771 characters
[12:50:39 AM] ℹ️ Parsing HTML to extract book data
[12:50:39 AM] ✅ SUCCESSFULLY EXTRACTED 3 BOOKS
[12:50:39 AM] 📋 EXTRACTED BOOKS SUMMARY
[12:50:39 AM] 📚 1. "Araminta Spookie 3: Frognapped" - Score: 100%%
[12:50:39 AM] 📚 2. "A Christmas Carol" - Score: 100%%
[12:50:39 AM] 📚 3. "A Series of Unfortunate Events #1: The Bad Beginning" - Score: 100%%
[12:50:39 AM] 📊 Total books extracted: 3
[12:50:39 AM] 📊 Average relevance score: 100%
[12:50:39 AM] ✅ Extracted 3 books from response
[12:50:39 AM] ℹ️ Saving 3 books to Excel file: test_results/suggest_3_books_for_childrens.xlsx
[12:50:39 AM] 📋 SAVING BOOKS TO EXCEL FILE
[12:50:39 AM] ℹ️ Target file path: test_results/suggest_3_books_for_childrens.xlsx
[12:50:39 AM] ℹ️ Exporting 3 books to Excel format
[12:50:39 AM] ✅ Book data saved to: test_results/suggest_3_books_for_childrens.xlsx
[12:50:39 AM] 📊 File verified - Size: 16.80 KB
[12:50:39 AM] ✅ ✓ Excel file creation verified successfully
[12:50:39 AM] 📋 STARTING INDIVIDUAL BOOK VALIDATION (3 books) for query: "Suggest 3 books for childrens"
[12:50:39 AM] 📋 📚 VALIDATING BOOK 1: "Araminta Spookie 3: Frognapped"
[12:50:39 AM] ℹ️ Starting comprehensive book validation
[12:50:39 AM] ℹ️ Validating title: "Araminta Spookie 3: Frognapped" vs expected: "Araminta Spookie 3: Frognapped"
[12:50:39 AM] ✅ ✅ TITLE VALIDATION PASSED: "Araminta Spookie 3: Frognapped"
[12:50:39 AM] ℹ️ Validating score: 100% vs expected: 100%
[12:50:39 AM] ✅ ✅ SCORE VALIDATION PASSED: 100% (expected 100%)
[12:50:39 AM] ✅ ✅ PERFECT SCORE GAP VALIDATION: Book has 100% score and no gap mentioned
[12:50:39 AM] ℹ️ Why-match points: extracted 3 vs expected 3
[12:50:39 AM] ✅ ✅ WHY-MATCH VALIDATION PASSED: 3 points (expected 3)
[12:50:39 AM] ✅ 🎉 BOOK 1 VALIDATION: ALL CHECKS PASSED!
[12:50:39 AM] ℹ️ Book 1 validation completed
[12:50:39 AM] 📋 📚 VALIDATING BOOK 2: "A Christmas Carol"
[12:50:39 AM] ℹ️ Starting comprehensive book validation
[12:50:39 AM] ℹ️ Validating title: "A Christmas Carol" vs expected: "A Christmas Carol"
[12:50:39 AM] ✅ ✅ TITLE VALIDATION PASSED: "A Christmas Carol"
[12:50:39 AM] ℹ️ Validating score: 100% vs expected: 100%
[12:50:39 AM] ✅ ✅ SCORE VALIDATION PASSED: 100% (expected 100%)
[12:50:39 AM] ✅ ✅ PERFECT SCORE GAP VALIDATION: Book has 100% score and no gap mentioned
[12:50:39 AM] ℹ️ Why-match points: extracted 3 vs expected 3
[12:50:39 AM] ✅ ✅ WHY-MATCH VALIDATION PASSED: 3 points (expected 3)
[12:50:39 AM] ✅ 🎉 BOOK 2 VALIDATION: ALL CHECKS PASSED!
[12:50:39 AM] ℹ️ Book 2 validation completed
[12:50:39 AM] 📋 📚 VALIDATING BOOK 3: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:50:39 AM] ℹ️ Starting comprehensive book validation
[12:50:39 AM] ℹ️ Validating title: "A Series of Unfortunate Events #1: The Bad Beginning" vs expected: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:50:39 AM] ✅ ✅ TITLE VALIDATION PASSED: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:50:39 AM] ℹ️ Validating score: 100% vs expected: 100%
[12:50:39 AM] ✅ ✅ SCORE VALIDATION PASSED: 100% (expected 100%)
[12:50:39 AM] ✅ ✅ PERFECT SCORE GAP VALIDATION: Book has 100% score and no gap mentioned
[12:50:39 AM] ℹ️ Why-match points: extracted 3 vs expected 3
[12:50:39 AM] ✅ ✅ WHY-MATCH VALIDATION PASSED: 3 points (expected 3)
[12:50:39 AM] ✅ 🎉 BOOK 3 VALIDATION: ALL CHECKS PASSED!
[12:50:39 AM] ℹ️ Book 3 validation completed
[12:50:39 AM] 📊 VALIDATION SUMMARY: 3/3 books passed
[12:50:39 AM] ✅ ALL BOOKS VALIDATED SUCCESSFULLY!
[12:50:39 AM] 📋 🔍 VALIDATING REASON-CITATION MATCHES
[12:50:39 AM] ℹ️ Starting citation validation process...
[12:50:39 AM] 📋 🚀 STARTING COMPLETE CITATION VALIDATION WORKFLOW
[12:50:39 AM] ℹ️ Step 1: Extracting books from AI response
[12:50:39 AM] 📋 EXTRACTING BOOK DATA FROM RESPONSE
[12:50:39 AM] ℹ️ Locating BookGenie response container
[12:50:39 AM] ℹ️ Extracting HTML content from response
[12:50:39 AM] ℹ️ HTML content extracted - Length: 26771 characters
[12:50:39 AM] ℹ️ Parsing HTML to extract book data
[12:50:39 AM] ✅ SUCCESSFULLY EXTRACTED 3 BOOKS
[12:50:39 AM] 📋 EXTRACTED BOOKS SUMMARY
[12:50:39 AM] 📚 1. "Araminta Spookie 3: Frognapped" - Score: 100%%
[12:50:39 AM] 📚 2. "A Christmas Carol" - Score: 100%%
[12:50:39 AM] 📚 3. "A Series of Unfortunate Events #1: The Bad Beginning" - Score: 100%%
[12:50:39 AM] 📊 Total books extracted: 3
[12:50:39 AM] 📊 Average relevance score: 100%
[12:50:39 AM] ℹ️ Step 2: Extracting citation texts from book elements
[12:50:39 AM] 📋 📚 EXTRACTING CITATION TEXTS FROM BOOK ELEMENTS
[12:50:39 AM] ℹ️ Step 1: Waiting for main book section
[12:50:39 AM] ℹ️ Found 7 total accordion sections
[12:50:39 AM] ℹ️ Found individual book: "1. Araminta Spookie 3: Frognapped"
[12:50:39 AM] ℹ️ Found individual book: "2. A Christmas Carol"
[12:50:39 AM] ℹ️ Found individual book: "3. A Series of Unfortunate Events #1: The Bad Beginning"
[12:50:39 AM] ℹ️ Processing 3 individual book sections
[12:50:39 AM] 📋 📖 PROCESSING BOOK 1: "Araminta Spookie 3: Frognapped"
[12:50:39 AM] ℹ️ Expanding book section: "Araminta Spookie 3: Frognapped"
[12:50:42 AM] ✅ Book section expanded: "Araminta Spookie 3: Frognapped"
[12:50:42 AM] ℹ️ Expanding "Why this book is the match" section for: "Araminta Spookie 3: Frognapped"
[12:50:45 AM] ✅ "Why this book is the match" section expanded for: "Araminta Spookie 3: Frognapped"
[12:50:45 AM] ℹ️ Found 4 citation buttons for "Araminta Spookie 3: Frognapped"
[12:50:45 AM] ℹ️ Extracting citation 1/4 for "Araminta Spookie 3: Frognapped"
[12:50:45 AM] ℹ️ Processing manuscript citation 1 for "Araminta Spookie 3: Frognapped"
[12:50:46 AM] ℹ️ Clicking to OPEN manuscript citation 1
[12:50:48 AM] ℹ️ Extracted citation text (first 100 chars): The book, *Araminta Spookie 3: Frognapped*, is part of author Angie Sage's extensive bibliography, w...
[12:50:48 AM] ℹ️ Clicking to CLOSE manuscript citation 1
[12:50:49 AM] ✅ ✅ manuscript citation 1 closed successfully
[12:50:49 AM] ℹ️ ✅ Citation 1 extracted successfully (length: 202)
[12:50:49 AM] ℹ️ Extracting citation 2/4 for "Araminta Spookie 3: Frognapped"
[12:50:49 AM] ℹ️ Processing manuscript citation 2 for "Araminta Spookie 3: Frognapped"
[12:50:50 AM] ℹ️ Clicking to OPEN manuscript citation 2
[12:50:53 AM] ℹ️ Extracted citation text (first 100 chars): solving mysteries...
[12:50:53 AM] ℹ️ Clicking to CLOSE manuscript citation 2
[12:50:54 AM] ✅ ✅ manuscript citation 2 closed successfully
[12:50:54 AM] ℹ️ ✅ Citation 2 extracted successfully (length: 17)
[12:50:54 AM] ℹ️ Extracting citation 3/4 for "Araminta Spookie 3: Frognapped"
[12:50:54 AM] ℹ️ Processing metadata citation 3 for "Araminta Spookie 3: Frognapped"
[12:50:55 AM] ℹ️ Clicking to OPEN metadata citation 3
[12:50:57 AM] ℹ️ Extracted citation text (first 100 chars): chapter books for kids ages 6-10...
[12:50:57 AM] ℹ️ Clicking to CLOSE metadata citation 3
[12:50:59 AM] ✅ ✅ metadata citation 3 closed successfully
[12:50:59 AM] ℹ️ ✅ Citation 3 extracted successfully (length: 32)
[12:50:59 AM] ℹ️ Extracting citation 4/4 for "Araminta Spookie 3: Frognapped"
[12:50:59 AM] ℹ️ Processing manuscript citation 4 for "Araminta Spookie 3: Frognapped"
[12:51:00 AM] ℹ️ Clicking to OPEN manuscript citation 4
[12:51:02 AM] ℹ️ Extracted citation text (first 100 chars): crediting illustrator Jimmy Pickering...
[12:51:02 AM] ℹ️ Clicking to CLOSE manuscript citation 4
[12:51:03 AM] ✅ ✅ manuscript citation 4 closed successfully
[12:51:03 AM] ℹ️ ✅ Citation 4 extracted successfully (length: 37)
[12:51:03 AM] ℹ️ Collapsing book section: "Araminta Spookie 3: Frognapped"
[12:51:05 AM] ✅ Book section collapsed: "Araminta Spookie 3: Frognapped"
[12:51:05 AM] ✅ ✅ Completed processing "Araminta Spookie 3: Frognapped" - 4 citations extracted
[12:51:05 AM] 📋 📖 PROCESSING BOOK 2: "A Christmas Carol"
[12:51:05 AM] ℹ️ Expanding book section: "A Christmas Carol"
[12:51:08 AM] ✅ Book section expanded: "A Christmas Carol"
[12:51:08 AM] ℹ️ Expanding "Why this book is the match" section for: "A Christmas Carol"
[12:51:11 AM] ✅ "Why this book is the match" section expanded for: "A Christmas Carol"
[12:51:11 AM] ℹ️ Found 3 citation buttons for "A Christmas Carol"
[12:51:11 AM] ℹ️ Extracting citation 1/3 for "A Christmas Carol"
[12:51:11 AM] ℹ️ Processing metadata citation 1 for "A Christmas Carol"
[12:51:12 AM] ℹ️ Clicking to OPEN metadata citation 1
[12:51:14 AM] ℹ️ Extracted citation text (first 100 chars): childrens christmas books...
[12:51:14 AM] ℹ️ Clicking to CLOSE metadata citation 1
[12:51:16 AM] ✅ ✅ metadata citation 1 closed successfully
[12:51:16 AM] ℹ️ ✅ Citation 1 extracted successfully (length: 25)
[12:51:16 AM] ℹ️ Extracting citation 2/3 for "A Christmas Carol"
[12:51:16 AM] ℹ️ Processing metadata citation 2 for "A Christmas Carol"
[12:51:17 AM] ℹ️ Clicking to OPEN metadata citation 2
[12:51:19 AM] ℹ️ Extracted citation text (first 100 chars): from 6 to 10...
[12:51:19 AM] ℹ️ Clicking to CLOSE metadata citation 2
[12:51:20 AM] ✅ ✅ metadata citation 2 closed successfully
[12:51:20 AM] ℹ️ ✅ Citation 2 extracted successfully (length: 12)
[12:51:20 AM] ℹ️ Extracting citation 3/3 for "A Christmas Carol"
[12:51:20 AM] ℹ️ Processing metadata citation 3 for "A Christmas Carol"
[12:51:21 AM] ℹ️ Clicking to OPEN metadata citation 3
[12:51:23 AM] ℹ️ Extracted citation text (first 100 chars): coloring...
[12:51:23 AM] ℹ️ Clicking to CLOSE metadata citation 3
[12:51:25 AM] ✅ ✅ metadata citation 3 closed successfully
[12:51:25 AM] ℹ️ ✅ Citation 3 extracted successfully (length: 8)
[12:51:25 AM] ℹ️ Collapsing book section: "A Christmas Carol"
[12:51:26 AM] ✅ Book section collapsed: "A Christmas Carol"
[12:51:26 AM] ✅ ✅ Completed processing "A Christmas Carol" - 3 citations extracted
[12:51:26 AM] 📋 📖 PROCESSING BOOK 3: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:26 AM] ℹ️ Expanding book section: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:30 AM] ✅ Book section expanded: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:30 AM] ℹ️ Expanding "Why this book is the match" section for: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:33 AM] ✅ "Why this book is the match" section expanded for: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:33 AM] ℹ️ Found 3 citation buttons for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:33 AM] ℹ️ Extracting citation 1/3 for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:33 AM] ℹ️ Processing metadata citation 1 for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:34 AM] ℹ️ Clicking to OPEN metadata citation 1
[12:51:36 AM] ℹ️ Extracted citation text (first 100 chars): children...
[12:51:36 AM] ℹ️ Clicking to CLOSE metadata citation 1
[12:51:37 AM] ✅ ✅ metadata citation 1 closed successfully
[12:51:37 AM] ℹ️ ✅ Citation 1 extracted successfully (length: 8)
[12:51:37 AM] ℹ️ Extracting citation 2/3 for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:37 AM] ℹ️ Processing metadata citation 2 for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:38 AM] ℹ️ Clicking to OPEN metadata citation 2
[12:51:40 AM] ℹ️ Extracted citation text (first 100 chars): Interest age, years: from 8 to 12...
[12:51:40 AM] ℹ️ Clicking to CLOSE metadata citation 2
[12:51:42 AM] ✅ ✅ metadata citation 2 closed successfully
[12:51:42 AM] ℹ️ ✅ Citation 2 extracted successfully (length: 33)
[12:51:42 AM] ℹ️ Extracting citation 3/3 for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:42 AM] ℹ️ Processing metadata citation 3 for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:43 AM] ℹ️ Clicking to OPEN metadata citation 3
[12:51:45 AM] ℹ️ Extracted citation text (first 100 chars): Humorous Stories...
[12:51:45 AM] ℹ️ Clicking to CLOSE metadata citation 3
[12:51:46 AM] ✅ ✅ metadata citation 3 closed successfully
[12:51:46 AM] ℹ️ ✅ Citation 3 extracted successfully (length: 16)
[12:51:46 AM] ℹ️ Collapsing book section: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:48 AM] ✅ Book section collapsed: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:48 AM] ✅ ✅ Completed processing "A Series of Unfortunate Events #1: The Bad Beginning" - 3 citations extracted
[12:51:48 AM] ✅ 🎉 Successfully extracted citations from 3 books
[12:51:48 AM] ℹ️ Step 3: Validating reason-citation matches
[12:51:48 AM] 📋 🔍 VALIDATING REASON-CITATION MATCHES (80% THRESHOLD)
[12:51:48 AM] ℹ️ 📖 Validating 3 reasons for: "Araminta Spookie 3: Frognapped"
[12:51:48 AM] ℹ️ Reason 1: Checking match...
[12:51:55 AM] ✅ ✅ "Araminta Spookie 3: Frognapped" - Reason 1: 95% match - PASS
[12:51:55 AM] ℹ️ Reason 2: Checking match...
[12:52:04 AM] ❌ ❌ "Araminta Spookie 3: Frognapped" - Reason 2: 0% match - FAIL
[12:52:04 AM] ❌ ⚠️ Citation text not found in reason: "solving mysteries"
[12:52:04 AM] ℹ️ Reason 3: Checking match...
[12:52:13 AM] ❌ ❌ "Araminta Spookie 3: Frognapped" - Reason 3: 0% match - FAIL
[12:52:13 AM] ❌ ⚠️ Citation text not found in reason: "chapter books for kids ages 6-10"
[12:52:13 AM] ℹ️ 📖 Validating 3 reasons for: "A Christmas Carol"
[12:52:13 AM] ℹ️ Reason 1: Checking match...
[12:52:13 AM] ❌ ❌ "A Christmas Carol" - Reason 1: 0% match - FAIL
[12:52:13 AM] ❌ ⚠️ Citation text not found in reason: "childrens christmas books"
[12:52:13 AM] ℹ️ Reason 2: Checking match...
[12:52:13 AM] ❌ ❌ "A Christmas Carol" - Reason 2: 0% match - FAIL
[12:52:13 AM] ❌ ⚠️ Citation text not found in reason: "from 6 to 10"
[12:52:13 AM] ℹ️ Reason 3: Checking match...
[12:52:13 AM] ✅ ✅ "A Christmas Carol" - Reason 3: 100% match - PASS
[12:52:13 AM] ℹ️ 📖 Validating 3 reasons for: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:52:13 AM] ℹ️ Reason 1: Checking match...
[12:52:13 AM] ✅ ✅ "A Series of Unfortunate Events #1: The Bad Beginning" - Reason 1: 100% match - PASS
[12:52:13 AM] ℹ️ Reason 2: Checking match...
[12:52:13 AM] ❌ ❌ "A Series of Unfortunate Events #1: The Bad Beginning" - Reason 2: 0% match - FAIL
[12:52:13 AM] ❌ ⚠️ Citation text not found in reason: "Interest age, years: from 8 to 12"
[12:52:13 AM] ℹ️ Reason 3: Checking match...
[12:52:13 AM] ❌ ❌ "A Series of Unfortunate Events #1: The Bad Beginning" - Reason 3: 0% match - FAIL
[12:52:13 AM] ❌ ⚠️ Citation text not found in reason: "Humorous Stories"
[12:52:13 AM] 📊 📊 CITATION VALIDATION SUMMARY: 3/9 passed (33.3%)
[12:52:13 AM] ❌ 💥 REASON-CITATION VALIDATION: OVERALL FAILED
[12:52:13 AM] ℹ️ Step 4: Generating detailed report
[12:52:13 AM] 📋 📋 GENERATING CITATION VALIDATION REPORT
[12:52:13 AM] ℹ️ Report generated: 3/9 reasons passed
[12:52:13 AM] ✅ ✅ Citation validation workflow completed successfully
[12:52:13 AM] 📊 📈 OVERALL CITATION VALIDATION: 3/9 (33.3%)
[12:52:13 AM] ❌ ❌ REASON-CITATION VALIDATION: OVERALL FAILED - Only 33.3% of reasons match citations (required: 80%)
[12:52:13 AM] 📋 📋 GENERATING DETAILED CITATION VALIDATION REPORT
[12:52:13 AM] ℹ️ Generating HTML citation validation report
[12:52:13 AM] ✅ Generated HTML report for 9 reasons
[12:52:13 AM] ✅ ✅ Citation validation HTML report generated and attached
[12:52:13 AM] ✅ ✅ Citation validation plain text report attached
[12:52:13 AM] ℹ️ Checking database connectivity...
[12:52:13 AM] ✅ ✅ Database connected successfully
[12:52:13 AM] ℹ️ Database path: /home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/test_data/database.xlsx
[12:52:13 AM] ℹ️ Total books: 5455
[12:52:13 AM] 📊 Database contains 5455 books
[12:52:13 AM] ✅ ✅ Database book count requirement met: 5455 >= 2020
[12:52:13 AM] 📋 🔍 VALIDATING EXTRACTED BOOKS INDIVIDUALLY AGAINST DATABASE
[12:52:13 AM] ℹ️ Checking book 1/3: "Araminta Spookie 3: Frognapped"
[12:52:13 AM] ℹ️ Checking if book exists in database: "Araminta Spookie 3: Frognapped"
[12:52:13 AM] ✅ ✅ Database match: "Araminta Spookie 3: Frognapped" → "Araminta Spookie 3: Frognapped"
[12:52:13 AM] ℹ️ Checking book 2/3: "A Christmas Carol"
[12:52:13 AM] ℹ️ Checking if book exists in database: "A Christmas Carol"
[12:52:14 AM] ✅ ✅ Database match: "A Christmas Carol" → "A Christmas Carol"
[12:52:14 AM] ℹ️ Checking book 3/3: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:52:14 AM] ℹ️ Checking if book exists in database: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:52:14 AM] ✅ ✅ Database match: "A Series of Unfortunate Events #1: The Bad Beginning" → "He"
[12:52:14 AM] 📊 INDIVIDUAL DATABASE VALIDATION SUMMARY: 3/3 books found in database
[12:52:14 AM] ✅ 🎉 ALL BOOKS VALIDATED SUCCESSFULLY AGAINST DATABASE!
[12:52:14 AM] 📋 🤖 VALIDATING RESPONSE RELEVANCE WITH GEMINI AI - PER BOOK ANALYSIS
[12:52:14 AM] ℹ️ Starting Gemini AI per-book relevance validation...
[12:52:14 AM] 📋 🤖 ANALYZING RESPONSE RELEVANCE WITH GEMINI AI - PER BOOK ANALYSIS
[12:52:14 AM] ℹ️ Starting Gemini AI analysis with retry logic...
[12:52:20 AM] ⚠ ⚠️ GEMINI VALIDATION: Using fallback analysis due to API issues
[12:52:20 AM] ℹ️ Overall Score: 70% (Fallback)
[12:52:20 AM] 📋 📖 ANALYSIS FOR: "Araminta Spookie 3: Frognapped" - Score: 70%
[12:52:20 AM] ℹ️ ❌ Author Information: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Publishing Date: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Why Match Explanations: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Relevance Scores: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ 💡 Book-specific improvements:
[12:52:20 AM] ℹ️ - Retry analysis when service is available
[12:52:20 AM] 📋 📖 ANALYSIS FOR: "A Christmas Carol" - Score: 70%
[12:52:20 AM] ℹ️ ❌ Author Information: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Publishing Date: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Why Match Explanations: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Relevance Scores: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ 💡 Book-specific improvements:
[12:52:20 AM] ℹ️ - Retry analysis when service is available
[12:52:20 AM] 📋 📖 ANALYSIS FOR: "A Series of Unfortunate Events #1: The Bad Beginning" - Score: 70%
[12:52:20 AM] ℹ️ ❌ Author Information: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Publishing Date: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Why Match Explanations: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Relevance Scores: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ 💡 Book-specific improvements:
[12:52:20 AM] ℹ️ - Retry analysis when service is available
[12:52:20 AM] ℹ️ 📊 SUMMARY FEEDBACK:
[12:52:20 AM] ℹ️ • AI analysis service is temporarily overloaded
[12:52:20 AM] ℹ️ • Using fallback analysis with neutral scores
[12:52:20 AM] ℹ️ • Error: [GoogleGenerativeAI Error]: Error fetching from https://generativelanguage.googleapis.com/v1beta/models/gemini-2.5-pro:generateContent: [429 Too Many Requests] You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits.
* Quota exceeded for metric: generativelanguage.googleapis.com/generate_content_free_tier_requests, limit: 2
Please retry in 39.676732925s. [{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_content_free_tier_requests","quotaId":"GenerateRequestsPerMinutePerProjectPerModel-FreeTier","quotaDimensions":{"location":"global","model":"gemini-2.5-pro"},"quotaValue":"2"}]},{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"39s"}]
[12:52:20 AM] ❌ ❌ GEMINI AI VALIDATION FAILED: 70% relevance score (required: 80%)
[12:52:20 AM] ℹ️ Continuing execution due to soft assertion...
=== END LOGS ===
Scenario Logs: Book Genie Response Validation with Citation Verification
[12:50:20 AM] Navigating to Creative Workspace login page
[12:50:22 AM] Homepage visibility: false
[12:50:22 AM] ℹ️ Typing query: "Suggest 3 books for childrens"
[12:50:22 AM] ℹ️ Preparing to type query: "Suggest 3 books for childrens"
[12:50:22 AM] ℹ️ Waiting for chat input to be visible
[12:50:23 AM] ℹ️ Clearing chat input
[12:50:23 AM] ℹ️ Typing query: "Suggest 3 books for childrens"
[12:50:25 AM] ℹ️ Pressing Enter to submit query
[12:50:25 AM] ✅ Query submitted successfully: "Suggest 3 books for childrens"
[12:50:25 AM] ℹ️ Waiting for AI to complete thinking...
[12:50:25 AM] 📋 WAITING FOR AI RESPONSE
[12:50:25 AM] ℹ️ Looking for AI thinking indicator...
[12:50:25 AM] ℹ️ Waiting for thinking indicator to appear (max 2 minutes)
[12:50:27 AM] ✅ ✓ AI thinking indicator appeared - AI is processing the request
[12:50:27 AM] ℹ️ Waiting for thinking indicator to disappear (max 5 minutes)
[12:50:36 AM] ✅ ✓ AI thinking completed - Response should be ready
[12:50:36 AM] ℹ️ Allowing additional time for response rendering
[12:50:39 AM] ✅ AI response wait process completed
[12:50:39 AM] ℹ️ Validating response for query: "Suggest 3 books for childrens"
[12:50:39 AM] 📋 VALIDATING RESPONSE FOR QUERY: "Suggest 3 books for childrens"
[12:50:39 AM] ℹ️ Locating the latest response in chat
[12:50:39 AM] ℹ️ Waiting for response to be visible (max 30 seconds)
[12:50:39 AM] ✅ Response received - Length: 2060 characters
[12:50:39 AM] ℹ️ Response preview: Watch Me WorkInterpreting context for your query...Retrieving Relevant Books for 'books suitable for...
[12:50:39 AM] ℹ️ Extracting book data from response...
[12:50:39 AM] 📋 EXTRACTING BOOK DATA FROM RESPONSE
[12:50:39 AM] ℹ️ Locating BookGenie response container
[12:50:39 AM] ℹ️ Extracting HTML content from response
[12:50:39 AM] ℹ️ HTML content extracted - Length: 26771 characters
[12:50:39 AM] ℹ️ Parsing HTML to extract book data
[12:50:39 AM] ✅ SUCCESSFULLY EXTRACTED 3 BOOKS
[12:50:39 AM] 📋 EXTRACTED BOOKS SUMMARY
[12:50:39 AM] 📚 1. "Araminta Spookie 3: Frognapped" - Score: 100%%
[12:50:39 AM] 📚 2. "A Christmas Carol" - Score: 100%%
[12:50:39 AM] 📚 3. "A Series of Unfortunate Events #1: The Bad Beginning" - Score: 100%%
[12:50:39 AM] 📊 Total books extracted: 3
[12:50:39 AM] 📊 Average relevance score: 100%
[12:50:39 AM] ✅ Extracted 3 books from response
[12:50:39 AM] ℹ️ Saving 3 books to Excel file: test_results/suggest_3_books_for_childrens.xlsx
[12:50:39 AM] 📋 SAVING BOOKS TO EXCEL FILE
[12:50:39 AM] ℹ️ Target file path: test_results/suggest_3_books_for_childrens.xlsx
[12:50:39 AM] ℹ️ Exporting 3 books to Excel format
[12:50:39 AM] ✅ Book data saved to: test_results/suggest_3_books_for_childrens.xlsx
[12:50:39 AM] 📊 File verified - Size: 16.80 KB
[12:50:39 AM] ✅ ✓ Excel file creation verified successfully
[12:50:39 AM] 📋 STARTING INDIVIDUAL BOOK VALIDATION (3 books) for query: "Suggest 3 books for childrens"
[12:50:39 AM] 📋 📚 VALIDATING BOOK 1: "Araminta Spookie 3: Frognapped"
[12:50:39 AM] ℹ️ Starting comprehensive book validation
[12:50:39 AM] ℹ️ Validating title: "Araminta Spookie 3: Frognapped" vs expected: "Araminta Spookie 3: Frognapped"
[12:50:39 AM] ✅ ✅ TITLE VALIDATION PASSED: "Araminta Spookie 3: Frognapped"
[12:50:39 AM] ℹ️ Validating score: 100% vs expected: 100%
[12:50:39 AM] ✅ ✅ SCORE VALIDATION PASSED: 100% (expected 100%)
[12:50:39 AM] ✅ ✅ PERFECT SCORE GAP VALIDATION: Book has 100% score and no gap mentioned
[12:50:39 AM] ℹ️ Why-match points: extracted 3 vs expected 3
[12:50:39 AM] ✅ ✅ WHY-MATCH VALIDATION PASSED: 3 points (expected 3)
[12:50:39 AM] ✅ 🎉 BOOK 1 VALIDATION: ALL CHECKS PASSED!
[12:50:39 AM] ℹ️ Book 1 validation completed
[12:50:39 AM] 📋 📚 VALIDATING BOOK 2: "A Christmas Carol"
[12:50:39 AM] ℹ️ Starting comprehensive book validation
[12:50:39 AM] ℹ️ Validating title: "A Christmas Carol" vs expected: "A Christmas Carol"
[12:50:39 AM] ✅ ✅ TITLE VALIDATION PASSED: "A Christmas Carol"
[12:50:39 AM] ℹ️ Validating score: 100% vs expected: 100%
[12:50:39 AM] ✅ ✅ SCORE VALIDATION PASSED: 100% (expected 100%)
[12:50:39 AM] ✅ ✅ PERFECT SCORE GAP VALIDATION: Book has 100% score and no gap mentioned
[12:50:39 AM] ℹ️ Why-match points: extracted 3 vs expected 3
[12:50:39 AM] ✅ ✅ WHY-MATCH VALIDATION PASSED: 3 points (expected 3)
[12:50:39 AM] ✅ 🎉 BOOK 2 VALIDATION: ALL CHECKS PASSED!
[12:50:39 AM] ℹ️ Book 2 validation completed
[12:50:39 AM] 📋 📚 VALIDATING BOOK 3: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:50:39 AM] ℹ️ Starting comprehensive book validation
[12:50:39 AM] ℹ️ Validating title: "A Series of Unfortunate Events #1: The Bad Beginning" vs expected: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:50:39 AM] ✅ ✅ TITLE VALIDATION PASSED: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:50:39 AM] ℹ️ Validating score: 100% vs expected: 100%
[12:50:39 AM] ✅ ✅ SCORE VALIDATION PASSED: 100% (expected 100%)
[12:50:39 AM] ✅ ✅ PERFECT SCORE GAP VALIDATION: Book has 100% score and no gap mentioned
[12:50:39 AM] ℹ️ Why-match points: extracted 3 vs expected 3
[12:50:39 AM] ✅ ✅ WHY-MATCH VALIDATION PASSED: 3 points (expected 3)
[12:50:39 AM] ✅ 🎉 BOOK 3 VALIDATION: ALL CHECKS PASSED!
[12:50:39 AM] ℹ️ Book 3 validation completed
[12:50:39 AM] 📊 VALIDATION SUMMARY: 3/3 books passed
[12:50:39 AM] ✅ ALL BOOKS VALIDATED SUCCESSFULLY!
[12:50:39 AM] 📋 🔍 VALIDATING REASON-CITATION MATCHES
[12:50:39 AM] ℹ️ Starting citation validation process...
[12:50:39 AM] 📋 🚀 STARTING COMPLETE CITATION VALIDATION WORKFLOW
[12:50:39 AM] ℹ️ Step 1: Extracting books from AI response
[12:50:39 AM] 📋 EXTRACTING BOOK DATA FROM RESPONSE
[12:50:39 AM] ℹ️ Locating BookGenie response container
[12:50:39 AM] ℹ️ Extracting HTML content from response
[12:50:39 AM] ℹ️ HTML content extracted - Length: 26771 characters
[12:50:39 AM] ℹ️ Parsing HTML to extract book data
[12:50:39 AM] ✅ SUCCESSFULLY EXTRACTED 3 BOOKS
[12:50:39 AM] 📋 EXTRACTED BOOKS SUMMARY
[12:50:39 AM] 📚 1. "Araminta Spookie 3: Frognapped" - Score: 100%%
[12:50:39 AM] 📚 2. "A Christmas Carol" - Score: 100%%
[12:50:39 AM] 📚 3. "A Series of Unfortunate Events #1: The Bad Beginning" - Score: 100%%
[12:50:39 AM] 📊 Total books extracted: 3
[12:50:39 AM] 📊 Average relevance score: 100%
[12:50:39 AM] ℹ️ Step 2: Extracting citation texts from book elements
[12:50:39 AM] 📋 📚 EXTRACTING CITATION TEXTS FROM BOOK ELEMENTS
[12:50:39 AM] ℹ️ Step 1: Waiting for main book section
[12:50:39 AM] ℹ️ Found 7 total accordion sections
[12:50:39 AM] ℹ️ Found individual book: "1. Araminta Spookie 3: Frognapped"
[12:50:39 AM] ℹ️ Found individual book: "2. A Christmas Carol"
[12:50:39 AM] ℹ️ Found individual book: "3. A Series of Unfortunate Events #1: The Bad Beginning"
[12:50:39 AM] ℹ️ Processing 3 individual book sections
[12:50:39 AM] 📋 📖 PROCESSING BOOK 1: "Araminta Spookie 3: Frognapped"
[12:50:39 AM] ℹ️ Expanding book section: "Araminta Spookie 3: Frognapped"
[12:50:42 AM] ✅ Book section expanded: "Araminta Spookie 3: Frognapped"
[12:50:42 AM] ℹ️ Expanding "Why this book is the match" section for: "Araminta Spookie 3: Frognapped"
[12:50:45 AM] ✅ "Why this book is the match" section expanded for: "Araminta Spookie 3: Frognapped"
[12:50:45 AM] ℹ️ Found 4 citation buttons for "Araminta Spookie 3: Frognapped"
[12:50:45 AM] ℹ️ Extracting citation 1/4 for "Araminta Spookie 3: Frognapped"
[12:50:45 AM] ℹ️ Processing manuscript citation 1 for "Araminta Spookie 3: Frognapped"
[12:50:46 AM] ℹ️ Clicking to OPEN manuscript citation 1
[12:50:48 AM] ℹ️ Extracted citation text (first 100 chars): The book, *Araminta Spookie 3: Frognapped*, is part of author Angie Sage's extensive bibliography, w...
[12:50:48 AM] ℹ️ Clicking to CLOSE manuscript citation 1
[12:50:49 AM] ✅ ✅ manuscript citation 1 closed successfully
[12:50:49 AM] ℹ️ ✅ Citation 1 extracted successfully (length: 202)
[12:50:49 AM] ℹ️ Extracting citation 2/4 for "Araminta Spookie 3: Frognapped"
[12:50:49 AM] ℹ️ Processing manuscript citation 2 for "Araminta Spookie 3: Frognapped"
[12:50:50 AM] ℹ️ Clicking to OPEN manuscript citation 2
[12:50:53 AM] ℹ️ Extracted citation text (first 100 chars): solving mysteries...
[12:50:53 AM] ℹ️ Clicking to CLOSE manuscript citation 2
[12:50:54 AM] ✅ ✅ manuscript citation 2 closed successfully
[12:50:54 AM] ℹ️ ✅ Citation 2 extracted successfully (length: 17)
[12:50:54 AM] ℹ️ Extracting citation 3/4 for "Araminta Spookie 3: Frognapped"
[12:50:54 AM] ℹ️ Processing metadata citation 3 for "Araminta Spookie 3: Frognapped"
[12:50:55 AM] ℹ️ Clicking to OPEN metadata citation 3
[12:50:57 AM] ℹ️ Extracted citation text (first 100 chars): chapter books for kids ages 6-10...
[12:50:57 AM] ℹ️ Clicking to CLOSE metadata citation 3
[12:50:59 AM] ✅ ✅ metadata citation 3 closed successfully
[12:50:59 AM] ℹ️ ✅ Citation 3 extracted successfully (length: 32)
[12:50:59 AM] ℹ️ Extracting citation 4/4 for "Araminta Spookie 3: Frognapped"
[12:50:59 AM] ℹ️ Processing manuscript citation 4 for "Araminta Spookie 3: Frognapped"
[12:51:00 AM] ℹ️ Clicking to OPEN manuscript citation 4
[12:51:02 AM] ℹ️ Extracted citation text (first 100 chars): crediting illustrator Jimmy Pickering...
[12:51:02 AM] ℹ️ Clicking to CLOSE manuscript citation 4
[12:51:03 AM] ✅ ✅ manuscript citation 4 closed successfully
[12:51:03 AM] ℹ️ ✅ Citation 4 extracted successfully (length: 37)
[12:51:03 AM] ℹ️ Collapsing book section: "Araminta Spookie 3: Frognapped"
[12:51:05 AM] ✅ Book section collapsed: "Araminta Spookie 3: Frognapped"
[12:51:05 AM] ✅ ✅ Completed processing "Araminta Spookie 3: Frognapped" - 4 citations extracted
[12:51:05 AM] 📋 📖 PROCESSING BOOK 2: "A Christmas Carol"
[12:51:05 AM] ℹ️ Expanding book section: "A Christmas Carol"
[12:51:08 AM] ✅ Book section expanded: "A Christmas Carol"
[12:51:08 AM] ℹ️ Expanding "Why this book is the match" section for: "A Christmas Carol"
[12:51:11 AM] ✅ "Why this book is the match" section expanded for: "A Christmas Carol"
[12:51:11 AM] ℹ️ Found 3 citation buttons for "A Christmas Carol"
[12:51:11 AM] ℹ️ Extracting citation 1/3 for "A Christmas Carol"
[12:51:11 AM] ℹ️ Processing metadata citation 1 for "A Christmas Carol"
[12:51:12 AM] ℹ️ Clicking to OPEN metadata citation 1
[12:51:14 AM] ℹ️ Extracted citation text (first 100 chars): childrens christmas books...
[12:51:14 AM] ℹ️ Clicking to CLOSE metadata citation 1
[12:51:16 AM] ✅ ✅ metadata citation 1 closed successfully
[12:51:16 AM] ℹ️ ✅ Citation 1 extracted successfully (length: 25)
[12:51:16 AM] ℹ️ Extracting citation 2/3 for "A Christmas Carol"
[12:51:16 AM] ℹ️ Processing metadata citation 2 for "A Christmas Carol"
[12:51:17 AM] ℹ️ Clicking to OPEN metadata citation 2
[12:51:19 AM] ℹ️ Extracted citation text (first 100 chars): from 6 to 10...
[12:51:19 AM] ℹ️ Clicking to CLOSE metadata citation 2
[12:51:20 AM] ✅ ✅ metadata citation 2 closed successfully
[12:51:20 AM] ℹ️ ✅ Citation 2 extracted successfully (length: 12)
[12:51:20 AM] ℹ️ Extracting citation 3/3 for "A Christmas Carol"
[12:51:20 AM] ℹ️ Processing metadata citation 3 for "A Christmas Carol"
[12:51:21 AM] ℹ️ Clicking to OPEN metadata citation 3
[12:51:23 AM] ℹ️ Extracted citation text (first 100 chars): coloring...
[12:51:23 AM] ℹ️ Clicking to CLOSE metadata citation 3
[12:51:25 AM] ✅ ✅ metadata citation 3 closed successfully
[12:51:25 AM] ℹ️ ✅ Citation 3 extracted successfully (length: 8)
[12:51:25 AM] ℹ️ Collapsing book section: "A Christmas Carol"
[12:51:26 AM] ✅ Book section collapsed: "A Christmas Carol"
[12:51:26 AM] ✅ ✅ Completed processing "A Christmas Carol" - 3 citations extracted
[12:51:26 AM] 📋 📖 PROCESSING BOOK 3: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:26 AM] ℹ️ Expanding book section: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:30 AM] ✅ Book section expanded: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:30 AM] ℹ️ Expanding "Why this book is the match" section for: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:33 AM] ✅ "Why this book is the match" section expanded for: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:33 AM] ℹ️ Found 3 citation buttons for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:33 AM] ℹ️ Extracting citation 1/3 for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:33 AM] ℹ️ Processing metadata citation 1 for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:34 AM] ℹ️ Clicking to OPEN metadata citation 1
[12:51:36 AM] ℹ️ Extracted citation text (first 100 chars): children...
[12:51:36 AM] ℹ️ Clicking to CLOSE metadata citation 1
[12:51:37 AM] ✅ ✅ metadata citation 1 closed successfully
[12:51:37 AM] ℹ️ ✅ Citation 1 extracted successfully (length: 8)
[12:51:37 AM] ℹ️ Extracting citation 2/3 for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:37 AM] ℹ️ Processing metadata citation 2 for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:38 AM] ℹ️ Clicking to OPEN metadata citation 2
[12:51:40 AM] ℹ️ Extracted citation text (first 100 chars): Interest age, years: from 8 to 12...
[12:51:40 AM] ℹ️ Clicking to CLOSE metadata citation 2
[12:51:42 AM] ✅ ✅ metadata citation 2 closed successfully
[12:51:42 AM] ℹ️ ✅ Citation 2 extracted successfully (length: 33)
[12:51:42 AM] ℹ️ Extracting citation 3/3 for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:42 AM] ℹ️ Processing metadata citation 3 for "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:43 AM] ℹ️ Clicking to OPEN metadata citation 3
[12:51:45 AM] ℹ️ Extracted citation text (first 100 chars): Humorous Stories...
[12:51:45 AM] ℹ️ Clicking to CLOSE metadata citation 3
[12:51:46 AM] ✅ ✅ metadata citation 3 closed successfully
[12:51:46 AM] ℹ️ ✅ Citation 3 extracted successfully (length: 16)
[12:51:46 AM] ℹ️ Collapsing book section: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:48 AM] ✅ Book section collapsed: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:51:48 AM] ✅ ✅ Completed processing "A Series of Unfortunate Events #1: The Bad Beginning" - 3 citations extracted
[12:51:48 AM] ✅ 🎉 Successfully extracted citations from 3 books
[12:51:48 AM] ℹ️ Step 3: Validating reason-citation matches
[12:51:48 AM] 📋 🔍 VALIDATING REASON-CITATION MATCHES (80% THRESHOLD)
[12:51:48 AM] ℹ️ 📖 Validating 3 reasons for: "Araminta Spookie 3: Frognapped"
[12:51:48 AM] ℹ️ Reason 1: Checking match...
[12:51:55 AM] ✅ ✅ "Araminta Spookie 3: Frognapped" - Reason 1: 95% match - PASS
[12:51:55 AM] ℹ️ Reason 2: Checking match...
[12:52:04 AM] ❌ ❌ "Araminta Spookie 3: Frognapped" - Reason 2: 0% match - FAIL
[12:52:04 AM] ❌ ⚠️ Citation text not found in reason: "solving mysteries"
[12:52:04 AM] ℹ️ Reason 3: Checking match...
[12:52:13 AM] ❌ ❌ "Araminta Spookie 3: Frognapped" - Reason 3: 0% match - FAIL
[12:52:13 AM] ❌ ⚠️ Citation text not found in reason: "chapter books for kids ages 6-10"
[12:52:13 AM] ℹ️ 📖 Validating 3 reasons for: "A Christmas Carol"
[12:52:13 AM] ℹ️ Reason 1: Checking match...
[12:52:13 AM] ❌ ❌ "A Christmas Carol" - Reason 1: 0% match - FAIL
[12:52:13 AM] ❌ ⚠️ Citation text not found in reason: "childrens christmas books"
[12:52:13 AM] ℹ️ Reason 2: Checking match...
[12:52:13 AM] ❌ ❌ "A Christmas Carol" - Reason 2: 0% match - FAIL
[12:52:13 AM] ❌ ⚠️ Citation text not found in reason: "from 6 to 10"
[12:52:13 AM] ℹ️ Reason 3: Checking match...
[12:52:13 AM] ✅ ✅ "A Christmas Carol" - Reason 3: 100% match - PASS
[12:52:13 AM] ℹ️ 📖 Validating 3 reasons for: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:52:13 AM] ℹ️ Reason 1: Checking match...
[12:52:13 AM] ✅ ✅ "A Series of Unfortunate Events #1: The Bad Beginning" - Reason 1: 100% match - PASS
[12:52:13 AM] ℹ️ Reason 2: Checking match...
[12:52:13 AM] ❌ ❌ "A Series of Unfortunate Events #1: The Bad Beginning" - Reason 2: 0% match - FAIL
[12:52:13 AM] ❌ ⚠️ Citation text not found in reason: "Interest age, years: from 8 to 12"
[12:52:13 AM] ℹ️ Reason 3: Checking match...
[12:52:13 AM] ❌ ❌ "A Series of Unfortunate Events #1: The Bad Beginning" - Reason 3: 0% match - FAIL
[12:52:13 AM] ❌ ⚠️ Citation text not found in reason: "Humorous Stories"
[12:52:13 AM] 📊 📊 CITATION VALIDATION SUMMARY: 3/9 passed (33.3%)
[12:52:13 AM] ❌ 💥 REASON-CITATION VALIDATION: OVERALL FAILED
[12:52:13 AM] ℹ️ Step 4: Generating detailed report
[12:52:13 AM] 📋 📋 GENERATING CITATION VALIDATION REPORT
[12:52:13 AM] ℹ️ Report generated: 3/9 reasons passed
[12:52:13 AM] ✅ ✅ Citation validation workflow completed successfully
[12:52:13 AM] 📊 📈 OVERALL CITATION VALIDATION: 3/9 (33.3%)
[12:52:13 AM] ❌ ❌ REASON-CITATION VALIDATION: OVERALL FAILED - Only 33.3% of reasons match citations (required: 80%)
[12:52:13 AM] 📋 📋 GENERATING DETAILED CITATION VALIDATION REPORT
[12:52:13 AM] ℹ️ Generating HTML citation validation report
[12:52:13 AM] ✅ Generated HTML report for 9 reasons
[12:52:13 AM] ✅ ✅ Citation validation HTML report generated and attached
[12:52:13 AM] ✅ ✅ Citation validation plain text report attached
[12:52:13 AM] ℹ️ Checking database connectivity...
[12:52:13 AM] ✅ ✅ Database connected successfully
[12:52:13 AM] ℹ️ Database path: /home/runner/work/HC_Epub_Automation/HC_Epub_Automation/tests/test_data/database.xlsx
[12:52:13 AM] ℹ️ Total books: 5455
[12:52:13 AM] 📊 Database contains 5455 books
[12:52:13 AM] ✅ ✅ Database book count requirement met: 5455 >= 2020
[12:52:13 AM] 📋 🔍 VALIDATING EXTRACTED BOOKS INDIVIDUALLY AGAINST DATABASE
[12:52:13 AM] ℹ️ Checking book 1/3: "Araminta Spookie 3: Frognapped"
[12:52:13 AM] ℹ️ Checking if book exists in database: "Araminta Spookie 3: Frognapped"
[12:52:13 AM] ✅ ✅ Database match: "Araminta Spookie 3: Frognapped" → "Araminta Spookie 3: Frognapped"
[12:52:13 AM] ℹ️ Checking book 2/3: "A Christmas Carol"
[12:52:13 AM] ℹ️ Checking if book exists in database: "A Christmas Carol"
[12:52:14 AM] ✅ ✅ Database match: "A Christmas Carol" → "A Christmas Carol"
[12:52:14 AM] ℹ️ Checking book 3/3: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:52:14 AM] ℹ️ Checking if book exists in database: "A Series of Unfortunate Events #1: The Bad Beginning"
[12:52:14 AM] ✅ ✅ Database match: "A Series of Unfortunate Events #1: The Bad Beginning" → "He"
[12:52:14 AM] 📊 INDIVIDUAL DATABASE VALIDATION SUMMARY: 3/3 books found in database
[12:52:14 AM] ✅ 🎉 ALL BOOKS VALIDATED SUCCESSFULLY AGAINST DATABASE!
[12:52:14 AM] 📋 🤖 VALIDATING RESPONSE RELEVANCE WITH GEMINI AI - PER BOOK ANALYSIS
[12:52:14 AM] ℹ️ Starting Gemini AI per-book relevance validation...
[12:52:14 AM] 📋 🤖 ANALYZING RESPONSE RELEVANCE WITH GEMINI AI - PER BOOK ANALYSIS
[12:52:14 AM] ℹ️ Starting Gemini AI analysis with retry logic...
[12:52:20 AM] ⚠ ⚠️ GEMINI VALIDATION: Using fallback analysis due to API issues
[12:52:20 AM] ℹ️ Overall Score: 70% (Fallback)
[12:52:20 AM] 📋 📖 ANALYSIS FOR: "Araminta Spookie 3: Frognapped" - Score: 70%
[12:52:20 AM] ℹ️ ❌ Author Information: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Publishing Date: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Why Match Explanations: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Relevance Scores: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ 💡 Book-specific improvements:
[12:52:20 AM] ℹ️ - Retry analysis when service is available
[12:52:20 AM] 📋 📖 ANALYSIS FOR: "A Christmas Carol" - Score: 70%
[12:52:20 AM] ℹ️ ❌ Author Information: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Publishing Date: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Why Match Explanations: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Relevance Scores: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ 💡 Book-specific improvements:
[12:52:20 AM] ℹ️ - Retry analysis when service is available
[12:52:20 AM] 📋 📖 ANALYSIS FOR: "A Series of Unfortunate Events #1: The Bad Beginning" - Score: 70%
[12:52:20 AM] ℹ️ ❌ Author Information: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Publishing Date: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Why Match Explanations: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ ❌ Relevance Scores: 70% - Analysis unavailable - API error
[12:52:20 AM] ℹ️ 💡 Book-specific improvements:
[12:52:20 AM] ℹ️ - Retry analysis when service is available
[12:52:20 AM] ℹ️ 📊 SUMMARY FEEDBACK:
[12:52:20 AM] ℹ️ • AI analysis service is temporarily overloaded
[12:52:20 AM] ℹ️ • Using fallback analysis with neutral scores
[12:52:20 AM] ℹ️ • Error: [GoogleGenerativeAI Error]: Error fetching from https://generativelanguage.googleapis.com/v1beta/models/gemini-2.5-pro:generateContent: [429 Too Many Requests] You exceeded your current quota, please check your plan and billing details. For more information on this error, head to: https://ai.google.dev/gemini-api/docs/rate-limits.
* Quota exceeded for metric: generativelanguage.googleapis.com/generate_content_free_tier_requests, limit: 2
Please retry in 39.676732925s. [{"@type":"type.googleapis.com/google.rpc.QuotaFailure","violations":[{"quotaMetric":"generativelanguage.googleapis.com/generate_content_free_tier_requests","quotaId":"GenerateRequestsPerMinutePerProjectPerModel-FreeTier","quotaDimensions":{"location":"global","model":"gemini-2.5-pro"},"quotaValue":"2"}]},{"@type":"type.googleapis.com/google.rpc.Help","links":[{"description":"Learn more about Gemini API quotas","url":"https://ai.google.dev/gemini-api/docs/rate-limits"}]},{"@type":"type.googleapis.com/google.rpc.RetryInfo","retryDelay":"39s"}]
[12:52:20 AM] ❌ ❌ GEMINI AI VALIDATION FAILED: 70% relevance score (required: 80%)
[12:52:20 AM] ℹ️ Continuing execution due to soft assertion...